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1 Field of the Invention: 

2 1 . This invention relates generally to broadcasting streaming data over a 

3 network. More particularly, the present invention is a system for avoiding a single point 

4 failure when multicasting a data stream comprising video, audio and other data. 

5 Background of the Invention: 

6 2. Multicast streaming services provide for the continual feed of streaming 

7 data, including video, over a network to many different users. The most common 

8 application is streaming video across a network system. Audio streaming is another 

9 common application. However, these streaming application types are not intended as a 

10 limitation. Typically, a particular data stream is multicast from a single server over a 

1 1 network. This allows many people to receive and view the same program 

12 simultaneously. 

13 3 . If however, the server becomes unavailable, then the multicast stream 

14 which is being served from the server will also be unavailable, thus leading to an outage 

15 of service. 

16 4. Increasingly, the lines between cable television service and serving a data 

17 stream over the Internet is becoming blurred. More and more, television-like content is 

18 being served to users of the Internet. This is becoming increasingly so in an era where 

19 bandwidth is increasing, and is readily available to Internet users. Today, Internet cable, 

20 DSL, and other types of high bandwidth lines are readily available to Internet users. 

21 Such users are demanding more and more content. 
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1 5. When a web based asset is used to stream video to Internet users, 

2 especially multiple users, there are generally two schemes that are employed. First, a 

3 unicast of the data stream is made to a single user. In a unicast situation, a single user 

4 connects to a website having program content. Upon demand, that program content is 

5 served by the web server to the individual user. When multiple users desire a particular 

6 program at different times, multiple unicasts of the data are made by the server. 

7 However, a single server can only serve a finite number of unicast streams of a given 

8 program content. 

9 6. Multiple streaming servers are used to load balance unicast data to many 

10 individual users. If a particular server fails, each user suffers an outage, albeit of differing 

1 1 content initiated at different times. Frequently multiple streaming servers are used in 

12 order to achieve load balancing and to allow multiple unicast streams of the same web 

13 asset. This approach works well when an equal number of video streams are served from 

14 each of the servers. However, if any server goes down, the individuals who are being 

15 served from that server will have their service disrupted. 

16 7. When a streaming server is distributing a video stream in a multicast mode 

17 (that is, simultaneous streaming of a video stream by multiple users), rather than in 

18 multiple unicast streams, the load on the server is relatively low. This is because a single 

19 stream per program is being broadcast by the server to multiple users, therefore multiple 

20 interactions with the server are not required for a single program. In a multicast situation, 

21 load balancing is not as much of an issue and therefore, multiple servers are not required. 

22 These relatively unused stream server resources can be used to increase the program 

23 availability by providing redundant servers of the same content 
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1 8. What would be particularly useful is a system which allows for the unicast 

2 or multicast of a video stream with the reliability that is associated with redundancy in 

3 the system. 

4 Summary of the Invention: 

5 9. The present invention is a system and method for harnessing the relatively 

6 under utilized streaming servers as redundant servers to minimize user outage due to a 

7 server failure particularly under multicast mode. 

8 

9 10. It is therefore an objective of the present invention to improve the 

10 reliability of multicast streaming service over a video cable network. 
^ 1 1 11. It is yet another objective of the present invention to improve the 

I-jj 12 reliability of multicast streaming service over networks serving clients. 
£13 12. It is a further objective of the present invention to improve the reliability 

is 14 of unicast broadcasts over client networks and over video networks. 
| H 15 13. It is a further objective of the present invention to introduce redundancy 

i s 5 

1 W 

:? 16 into the network serving multicast customers to improve reliability. 

j g 

sxr 17 14. It is yet another objective of the present invention to ensure that service is 

18 not interrupted to cable and network clients who are receiving stream data applications. 

19 15. The present invention is a system and method that is used in conjunction 

20 with redundant multicast servers to enhance the reliability of receipt of data stream 

21 desired. The use of two servers is the preferred embodiment although this is not meant as 

22 a limitation. More than two servers can be used although it is anticipated that there will 

23 not be a corresponding increase in reliability over the architecture that uses two multicast 

24 servers. One server broadcasts the primary stream. The other server broadcasts the 
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1 secondary stream. The secondary stream data content is identical with the primary stream 

2 data content. 

3 16. Each server multicasts the same content at the same time over the same 

4 enterprise network that is connected to the monitoring device of the present invention. An 

5 enterprise network may be a local area network, wide area network, intranet or any other 

6 network whereby the enterprise telecommunicates internally. For purposes of this 

7 application, the present invention is a system and method which includes a device that 

8 monitors for an adverse change of the primary multicasting server to utilize the secondary 

9 stream content when an adverse change is detected. An adverse change is a detected error 
10 which may range from corruption in the packet to the absence of the packet itself. This 

I ?3 1 1 device multicasts the secondary stream content to the users when the primary stream 

12 server undergoes an adverse change, including failure. Hence, the device that monitors 

P 

13 the two servers is termed a "failover" device. 

15 

j ;f 14 17. As noted above, each server multicasts the same content at the same time 

i"s I 
! 3 3 

! Sl5 over the same enterprise network connected to the failover device. The multicast stream 

□ 

rgl6 from each server is assigned a different DP address and port number. The failover device 

17 is configured to select from one of the multicast streams and designates that stream as the 

18 primary stream. The failover device designates the second multicast stream as the 

19 secondary stream. 

20 18. The failover device listens for both multicast streams. The device buffers 

21 the primary multicast stream packets as well as the secondary multicast stream packets. 

22 Under normal conditions, that is no adverse change is detected, the failover device takes a 

23 copy of the primary stream data packet to multicast. In the event of a primary stream 
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1 adverse change, the failover device takes a copy of secondary multicast server to 

2 multicast. The failover device overwrites the IP address and Port number in the packet it 

3 will multicast with its own virtual IP address and virtual port number. This virtual IP 

4 header information replaces the real IP header information that was in the original data 

5 packet. The rewritten data packet is then multicast by the failover device. The program 

6 data content (other than the IP header information) multicast by the failover device is 

7 therefore unaltered from the source data packet. As noted above, the secondary multicast 

8 stream packets are buffered but not otherwise used until an adverse change from the 

9 primary stream packet is detected. 

10 19. In this fashion, there is a minimal loss of content to the clients whether the 

;;fj 1 1 adverse changes are continuous or occasional. 

H 

g 12 20. The system of the present invention can be used by any application that 

;5 13 employs multicast streaming, including, but not limited to video and audio programming. 

j s U 14 Further, the present invention finds its best use for multicast traffic which does not have 

"0 15 stringent synchronization requirements and which can tolerate a minimal loss of data. 

u3 16 Video and audio streams are examples of the type of content that is well suited for this 

1 7 failover methodology. 

18 21. It should also be noted that while the failover device buffers and 

19 multicasts the packets, the failover device itself does not synchronize the multicast stream 

20 that is being broadcast by the multiple servers of the present invention. This is separately 

21 synchronized between the multicast servers. It does, however, synchronize the packets of 

22 data that are to be subsequently multicast. 
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1 22. The failover device may use the packet count information present in the 

2 packet header to synchronize the packets received from the primary and secondary 

3 multicast servers. This synchronization method is one embodiment and is not meant to be 

4 limiting. 

5 Brief Description of the Drawings : 



6 23. Figure 1 illustrates the functioning of the failover device. 

7 24. Figure 2 illustrates the buffering and switching associated with the failover 

8 device. 

9 Detailed Description of the Invention: 

10 25. As noted above, the present invention comprises a failover device 

1 1 monitoring redundant streaming servers in order to ensure reliability and uninterrupted 

12 service for viewers of video programs. 

13 26. Referring first to Figure 1, the functioning of the failover device is 

14 illustrated. Multicast server A 10 and multicast server B 12, each multicast the same 

15 content over the same enterprise network 14. The two multicast servers each constitute a 



16 Real Multicast transmitting a multicast IP address and Port (RMIPP). Each multicast 

17 server multicasts stream packets having IP headers associated with the address and port 

18 of the associated server. Each RMIPP is unique in order to avoid duplicate network 

19 traffic. Thus, in Figure 1, RMIPP- A represents the multicast channel from multicast 

20 server A over which a particular data stream is broadcast. The same video stream is 

21 multicast over RMIPP-B which represents the channel over which the same data stream 

22 is broadcast but, in this case, from multicast server B 12. 




1 27. The multicast content is received at the multicast stream failover device 16 

2 which comprises logic to select one of the multicast streams as the primary stream and 

3 the other stream as the failover or secondary stream. 

4 28. The failover device buffers the primary multicast stream packets in buffer 

5 18. Packets received from the secondary stream are buffered in buffer 20 (as more fully 

6 explained below). The failover device 16 can distinguish the source of the packets 

7 because the IP header information in each packet contains unique RMIPP. If there are no 

8 adverse changes detected in the primary data packet, the failover device overwrites the IP 

9 header information with its own Virtual Multicast IP address and Port number (VMIPP) 
■5 10 in the primary stream packet. If an adverse change is detected, the failover device selects 
Lfl 1 1 the secondary stream packet, overwriting the IP header information with its own VMIPP. 

12 29. Thereafter the failover device multicasts the packet comprised of rewritten 

y 13 packets with the new virtual multicast IP address and port number. The source of the 

ry 14 packet content is from the primary multicast server if there are no detectable adverse 

FU 

i-3 15 changes in the received packet. Otherwise the source is the secondary multicast server. 

□ 16 The failover device will synchronize the packets from the two multicast servers such that 

17 the next packet multicast, regardless of the content source, is the packet that sequentially 

18 follows the last packet multicast. Thus, the multicast failover device forwards the content 

19 stream from either RMIPP- A or RMIPP-B where the DP header is rewritten as VMIPP. 

20 30. Synchronization of the two video streams is carried out by the servers in 

21 communication with one another. Thus, the failover device performs a failover from one 

22 RMEPP to another RMIPP in the event that the primary RMIPP has evidence of some 

23 adverse change. As noted above, adverse change includes the loss of a packet from a 
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1 multicast stream as well as corruption of the data. Two multicast sources are 

2 synchronized in time and have access to the same source data and programming 

3 instructions (either via a shared disk 8 or from independent replicas of the data). By 

4 virtue of this synchronization, the servers 10, 12 multicast the same data (differing only 

5 in data source information) at the same time. Allowing both sources to be exact replicas 

6 makes configuration much simpler and does not require any additional development work 

7 to integrate into an architecture supporting Windows Media video multicasts. 

8 31. Multicast sources 10, 12 can be connected via separate physical ports or 

9 the same port depending on what mechanism is used to perform the actual filtering 

10 (L2/L3 sourcelD filters vs physical port filters). 

11 32. To provide accurate filtering logic, the system of the present invention 

12 optionally provides a Monitor 21 with access to the Programming data from the shared 

13 disk 8 (which is preferably in a reduced form which comprises the address and expected 

14 bitrate of every active multicast in a given time window). 

15 33. An optional "sniffer" hub 19 provides a higher level of certainty to the 

16 monitor via a second NIC card. Capturing duplicates of all backnet 14 traffic provides the 

17 Monitor 21 with a guaranteed view of the backnet 14 status. The certainty comes from 

18 additional knowledge concerning whether data loss is truly occurring at the multicast 

19 sources versus at the net, switch, or NIC card. It also allows the Monitor 21 to know if 

20 switching between sources will actually help (i.e. it can also monitor the non-active 

21 (redundant-mode) source whose packets are not forwarded to the frontnet 15 for 

22 subsequent distribution to receivers 26, 28, 30, 32, and 34). 
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1 34. Multicast packets on a particular address are forwarded from only one 

2 source at a time (i.e. redundant packets from secondary source are filtered out — there is 

3 no packet rewriting). Note that while not necessary as long as receiving clients use 

4 buffers and can recognize duplicate and misordered packets, it is possible to provide 

5 packet-level synchronization with buffering and perhaps some knowledge of the packet 

6 format. 

7 35. The Monitor 21 can control the failover mechanisms in the failover device 

8 16 switch via exposed SNMP controls 24. Thresholding logic in the failover device 16 

9 dictates when such a failover should occur and failover may be at the individual multicast 

0 10 stream or entire multicast source level. Note that while an external Monitor 21 is 

1 S 11 illustrated, this is not meant as a limitation. For example, the same functionality of 

jj 

12 filtering duplicate packets based on L2/L3 sourcelD or physical port can be implemented 

.5 13 within the failover device 16 which can be more flexible since it does not rely upon the 

^ 14 limited set of SNMP controls. 

1 jf 15 36. Windows Media player, whose capabilities are incorporated herein by 

^ 16 reference in their entirety, is capable of handling duplicate and misordered packets via a 

17 buffering mechanism so as to overcome the lack of sync at the packet level that would 

18 become apparent when a stream is rolled over between sources. 

19 37. Referring to Figure 2, the functioning and buffering of multicast content 

20 is illustrated. Primary streaming server 10 streams its data content using TP address 

21 X.X.X.X at port XX. Secondary streaming server 12 multicasts its data content, which is 

22 the same content and is synchronized with the content of primary streaming server 10, 

23 using IP address Y.Y. Y. Y at port YY. As noted earlier, these video streams are 
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1 synchronized with one another. Each video stream, from the primary streaming server 

2 and the secondary streaming server, is transmitted over the same enterprise network 14 to 

3 the failover device 16. 

4 38. The work that is sent to the customer, whether audio, video or other work, 

5 is the collection of data packets played in a strict sequence. While the packets may be 

6 delivered out of sequence, the playing device buffers the packets and orders the playing 

7 of the packets according to the packet sequence number found in the packet header area. 

8 For purposes of this description, packet content refers to the data viewed or heard by the 

9 end user, whereas header data includes IP addresses, port numbers and packet sequence 
J 10 numbers. As discussed below, packet sequence numbers are used to order the packets 

"■"■si 

Iff 1 1 within the failover device buffers. 

Ill 

H 12 39. Multicast failover device 16 buffers the packet stream both from the 

^ 13 primary streaming server 10 and from the secondary streaming server 12. The packets 

j-y 14 from each are buffered such that the multicast failover device at a point in time has 

ru 

uO 15 packet with sequence number X from the primary multicast stream and a packet from the 

Q 

U16 secondary multicast stream with identical content and the same sequence number X in a 

17 second buffer. Further, the failover device 16 also has packet X+l, packet X+2, packet 

18 X+3, packet X+4, etc. from the primary multicast stream as well as packet X+l, packet 

19 X+2, packet X+3, and packet X+4, etc. from the secondary multicast stream. 

20 40. While the multicast failover device does not synchronize the output of the 

21 primary and secondary streaming servers, 10, 12, it does synchronize the packets 

22 received so that the packets in the failover device buffers, at any point in time, contain the 
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1 same data content packets in each buffer in the same order. Each buffer's content, 

2 assuming no packet defects, should be identical in the respective buffers at the same time. 

3 41 . One method for packet synchronization at the failover device is to use this 

4 packet sequence number contained in the packet's header. Each transmitting server 

5 numbers each packet. The failover device inserts the received packets into the buffer at a 

6 buffer index location corresponding to the packet's number. For example, packet number 

7 X from the primary server will be placed in the buffer for the primary server at index 

8 location equal to X. 

9 42. Since programs are sufficiently large, the buffers are periodically recycled 

a 

vy 10 and overwritten. The packet number would be mapped by logic that converts the 

1 1 sequence number to an index value using a simple modulus mapping scheme. For 

i sJi 

^ 12 example, if the buffers are reused every one hundred packets, the logic to map to the 

pa 

T 13 appropriate index would be to divide the sequence number by 100 (modulus 100) and 

hi 14 insert the current packet at the index equal to the last two digits of the packet number. In 

i 1 5 this example the buffer indexes would range from 0 to 99. If the last valid packet seen by 

ill 

! =3 16 the failover device from the primary multicast system is, for example, packet with 

17 modulus M, then the failover device will continue broadcasting from the secondary 

18 stream buffer with packet with modulus M+l . In this fashion, clients will have 

19 continuity in their programs with no discernable interruption. 

20 43. Failover device 16 rewrites the IP headers with a virtual IP address 

21 Z.Z.Z.Z and port number ZZ, which is then multicast to clients on the network. 

22 44. The system and method where one program is being multicast in parallel 

23 with monitoring by a failover device that has remedial capability has been illustrated. 
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1 Those skilled in the art will appreciate that multiple programs may be broadcast at the 

2 same time where each program is under the same redundancy and monitoring system 

3 using the same equipment as explained above. Thus the present invention should not be 

4 limited to the broadcasting of a redundant single stream of data but to the broadcast of 

5 multiple streams of data as well. Thus, the present invention is not intended to be limited 

6 to one program broadcast at one time. Multiple programs may be run simultaneously. 

7 45. A system and method for multicast video stream failovers has been 

8 illustrated. It will be appreciated by those skilled in the art that other variations of the 

9 architecture illustrated will be possible without departing from the scope of the invention 

: £ 

kQ 10 as disclosed. 
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